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Using data from the Longitudinal Study of Mathematics Participation (N = 1,518 
students from 34 schools), we investigated the effects of pure and applied 
mathematics courses on mathematics achievement, controlling for prior mathematics 
achievement. Results of multilevel modelling showed that the effects of pure 
mathematics were significant after adjusting for traditionally important student-level 
predictors of achievement and for school effects. The effects of mathematics courses 
varied significantly across schools. Students taking pure mathematics achieved higher 
in smaller schools, particularly schools with higher teacher commitment. Students 
taking applied mathematics achieved higher if they attended smaller schools. 

Keywords: mathematics achievement; mathematics courses; multilevel modeling, 
Alberta education 

A Taide de donnees tirees de la Longitudinal Study of Mathematics Participation (N = 
1518 eleves dans 34 ecoles albertaines), les auteurs ont etudie les effets des cours de 
mathematiques pures et appliquees sur les competences en mathematiques en tenant 
compte des competences anterieures. Les resultats de la modelisation multiveau, une 
forme des modeles statistiques hierarchiques lineaires, indiquent que les effets des 
mathematiques pures sont significatifs une fois pris en compte les predicteurs de 
reussite les plus frequents ainsi que les effets des ecoles. Les effets des cours de 
mathematiques variaient d'une ecole a Tautre. Les eleves en mathematiques pures 
ont obtenu de meilleurs resultats dans les ecoles de plus petite taille, surtout dans 
celles ou les enseignants s'impliquent davantage. Les eleves en mathematiques 
appliquees ont eux-aussi obtenu de meilleurs resultats dans les ecoles de plus petite 
taille. 

Mots cles : reussite en mathematiques, cours de mathematiques, modelisation 
multiniveau, education en Alberta. 
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Many researchers have sought important predictors of mathematics 
achievement, with individual differences being fhe fradifional focus. 
Among sfudenf characferisfics influencing mafhematics achievement 
researchers have paid affenfion fo gender differences (e.g., Ma & Klinger, 
2000; Randhawa, 1991), socioeconomic differences (e.g.. Crane, 1996; Ma 
& Klinger, 2000), racial-efhnic differences (e.g., Ma & Klinger, 2000), and 
differences associafed wifh immigranf sfafus (e.g., Ma & Klinger, 2000; 
Wang & Goldschmidt 1999). Meanwhile, researchers have reached 
consensus fhaf schools are differenfially effecfive in leaching 
mafhemafics, as evidenced in fhe school effecfiveness movemenf (see 
Teddlie & Reynolds, 2000). Among school characferisfics influencing 
mafhemafics achievement researchers have attended fo school confexf 
and climafe (e.g., Lee, 2000; Ma & Klinger, 2000) and school policies and 
pracfices (e.g., Lee, Croninger, & Smifh, 1997; Luyfen, 1994). 

Researchers have also invesfigafed fhe effecfs of mafhemafics 
coursework on mafhemafics achievement, examining the impact of fhe 
number (amounf) and fhe type (content) of mafhemafics courses. Sebring 
(1987) nofed fhaf fhe quanfify of mafhemafics coursework had an effecf 
on mafhemafics achievemenf. Gamoran (1987) reporfed fhaf sfudenfs 
performed better on sfandardized mafhemafics achievemenf fesfs if fhey 
look more mafhemafics courses, and mafhemafics coursework 
parficularly differenfiafes mafhemafics achievemenf befween While and 
Black sfudenfs. Grouping sfudenfs based on gender (male and female) 
and race (while and non-whife), Jones (1987) claimed fhaf across all four 
groups, sfudenfs wifh more mafhemafics courses had higher 
mafhemafics achievemenf. 

Overah, fhere has been a push fo raise fhe academic sfandards in 
mafhemafics by increasing fhe number of mafhemafics courses sfudenfs 
musf complefe fo graduafe from high school. National sfudies in fhe 
Unifed Sfafes showed fhaf, after fhis requiremenf was implemenfed, fhe 
percenfage of sfudenfs faking pre-calculus changed from 15 per cenf fo 
17 per cenf, and for calculus fhe change was from 8 per cenf to 11 per 
cent (see Holler, 1997). However, many schools have responded fo fhis 
requiremenf by offering more low-level mafhemafics courses. Holler 
(1997) affribufed fhis sifuafion fo fhe fad fhaf "fhe school lacks fhe 
insfrucfional resources [e.g., hiring addifional feachers] fo implemenf fhe 
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policy properly" and "students are unwilling or unable to handle more 
difficult mathematics" (p. 587). According to Hoffer (1997), this 
"watered-down" requirement explains why the move to augment 
mathematics standards by increasing the number of mafhemafics courses 
sfudenfs musf complefe has nof increased mafhemafics achievemenf. He 
suggesfed fhaf if is imporfanf fo move "beyond simple course-counf 
requiremenfs fo an emphasis on specific curriculum confenf and acfual 
learning oufcomes" (p. 48). Perhaps if is fhe type or content of 
mafhemafics courses fhaf produces differences in mafhemafics 
achievemenf. 

Some sfudies have considered the differential effects of mafhemafics 
courses on sfudenfs' subsequenf mafhemafics achievemenf. In general, 
fhe type of mafhemafics courses sfudenfs complefe in high school is 
sfrongly associafed wifh fheir mafhemafics achievemenf. For example, 
analyfic geomefry and calculus are relafed fo sfudenfs' academic 
achievemenf (Sfribling, 1990). Smifh (1996) found fhaf sfudenfs who took 
formal algebra courses early (in grade 8) oufperformed sfudenfs who did 
nof on sfandardized mafhemafics achievemenf fests in bofh grades 10 
and 12. Ma (2000) reported fhaf every advanced mafhemafics course 
(algebra II, frigonomefry, analyfic geomefry, and calculus) has an effecf 
on mafhemafics achievemenf, even after accounfing for fradifionally 
imporfanf predicfors such as socio-economic sfafus (SES) and prior 
mafhemafics achievemenf. He concluded fhaf "fhe effecf of mafhemafics 
coursework was over and above fhe effecfs of academic background and 
individual characferisfics" (p. 26). Consisfenfly, fhese researchers 
described fhe confenf effecfs of mafhemafics courses as eifher sfrong or 
subsfanfial. 

These sfudies primarily examined fhe effecfs of mafhemafics 
coursework on mafhemafics achievemenf from fhe sfudenf perspecfive. 
However, school effecfs may be as imporfanf as individual differences. 
School characferisfics may mediafe fhe relationship befween 
mafhemafics coursework and mafhemafics achievemenf. School policies 
and practices on course offering and taking are certainly important to 
this relationship. As Smith (1996) asserted, the mathematics courses 
schools offer can influence sfudenfs' academic achievemenf and career 
aspirafion. Gamoran (1987) believed fhaf "curriculum differentiation 
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(tracking) may create stratified learning opportunities within schools" (p. 
135). This is particularly detrimental to the academic success of low- 
achieving sfudenfs because "fhey are fypically fracked info low-level, 
dead-end mafhemafics classes" (Gamoran, Porfer, Smifhson, & While, 
1997, p. 325). Lee, Croninger, and Smifh (1997) supporf fhis conclusion: 

Students are advantaged by attending schools where they and their classmates 
take more academic mathematics courses, in schools where more students 
pursue their studies within a college-preparatory program, and in schools whose 
mathematics curricula consist of higher proportions of academic courses. ( p. 112) 

What is lacking in the research literature is how school context and 
climate mediate the relationship between mathematics coursework and 
mathematics achievement. Our study adds empirical evidence from fhe 
perspecfive of school confexf and climafe fo fhe relatively fhin research 
liferafure on fhe relationship befween fhe confenf of mafhemafics 
coursework and fhe level of mafhemafics achievemenf. If is a direcf 
response fo fhe shiff in research focus from fhe number fo fhe type of 
mafhemafics courses, which has nof yef sfimulafed sufficienf sfudies fhaf 
invesfigafe fhe confenf of mafhemafics coursework as if relafes fo fhe 
level of mafhemafics achievemenf. 

In particular, almosf all research on mafhemafics coursework is 
conducfed oufside Canada. Several provinces have adopfed fhe policy 
and course offering of fhe pure/applied/essenfials sfreams. Whefher 
infenfional or nof, such a new policy focuses on confenf rafher fhan 
number of mafhemafics courses. This offers Canadian researchers an 
opporfunify fo be a parf of fhe ongoing debafe on confenf versus number 
in mafhemafics coursework. Cenfral fo fhis shiff is fhe quesfion: Can fhis 
new coursework policy improve mafhemafics achievemenf of Canadian 
sfudenfs? Focusing on sfudenfs af fhe beginning of high school, we 
specified fhree research questions fo address (a) whefher faking differenf 
mafhemafics courses made a significanf difference in mafhemafics 
achievemenf, (b) whefher fhese coursework effecfs varied significanfly 
across schools, and (c) whefher school characferisfics accounfed for fhe 
variation if fhese coursework effecfs varied across schools. 
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METHOD 

Subjects 

Data were drawn from the Longitudinal Study of Mathematics 
Participation (LSMP), a large-scale research project at the University of 
Alberta. Tenth-grade students were followed until their graduation year 
to identify student, teacher, and school characteristics that contributed to 
students' decision to participate in mathematics courses. The school was 
the sampling unit. Rogers and Wilson (1993), sampling schools from the 
central part of the province of Alberta, demonstrated that analytic results 
based on such a sampling strategy are representative of the entire 
province. For this reason, the LSMP adopted the same strategy, 
concentrating on the central part of the province. Schools were 
approached through school districts, with offers of financial 
compensation for interruption of regular instruction. As a result, 34 
schools with grades 10 to 12 from 11 school districts participated in the 
LSMP. 

Within each school, all students in grade 10 were invited to 
participate with parental consent. School contact persons (mathematics 
teachers in most cases) worked with members of the research team to 
distribute and collect parental consent letters. To encourage 
participation, free lunch was offered to students. Student participation 
rate varied from 40 per cent to 100 per cent across schools. School contact 
persons were asked to evaluate how representative students with 
parental consent were of all tenth graders in their schools and were 
particularly instructed to take note of patterns of non-participants (e.g., 
low SES students or students with learning difficulties in mathematics). 
Even in schools with relatively low participation rates, school contact 
persons were quite confident that non-participation did not indicate any 
evident concentration of students with common characteristics such as 
low SES or learning difficulties. The base-year data of the LSMP 
contained 1,518 students, representing 45 students per school. In 
addition, 155 mathematics teachers and 34 principals of participating 
students also participated. 
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Materials and Procedures 

Students completed a standardized mathematics achievement test. One 
questiormaire was administered to students, teachers, and principals to 
collect information on student and school characteristics expected to 
influence mafhemafics coursework. Mafhemafics achievemenf was fhe 
dependenf variable, measured wifh a mafhemafics subfesf of fhe 
Canadian Achievement Tests (2nd ed.) (CAT/2) (Canadian Tesf Cenfre, 
1992). The fesf is age-appropriafe fo sampled sfudenfs and assessed fheir 
abilify fo undersfand mafhemafical concepfs and apply fhis 
undersfanding fo solve mafhemafical problems. CAT/2 is essenfially a 
skill (or abilify) fesf, nof influenced by curricular confenf (Canadian Tesf 
Cenfre, personal communicafion, Sepfember, 1999). Therefore, fesfing 
resulfs were nof biased againsf sfudenfs in any course. 

Sfudenf-level characferisfics included confinuous variables of age, 
mofher SES, fafher SES, number of parenfs, and number of siblings as 
well as dichofomous variables of gender, immigranf sfudenf. Aboriginal 
sfudenf, or minorify sfudenf. All sfudenf-level variables were self 
explanatory in meaning, coming from single ifems on fhe sfudenf 
quesfiormaire, excepf SES. The convenfional measure of SES (for 
example, Duncan's socioeconomic index) is a sfandardized composite 
variable of parenfal educafion, parenfal occupafion, and household 
income. Because fhe research team was unable fo collecf informafion on 
household income, parenfal educafion and occupafion were combined fo 
create a sfandardized composite variable of SES following sfafisfical 
procedures ouflined in Mosfeller and Tukey (1977). 

Anofher imporfanf variable was prior mafhemafics achievemenf. 
Because fhe research team was unable to access student records, students 
were asked to provide final marks (in percenfage poinfs as commonly 
used in parficipafing schools) in mafhemafics in fhe previous year. We 
used prior mafhemafics achievemenf fo avoid a pofenfial temporal 
problem fhaf the superior performance of sfudenfs in advanced 
mafhemafics courses was a resulf of fheir superior prior performance 
(which may acfually lead fhem fo affend advanced mafhemafics 
courses). Wifh prior mafhemafics achievemenf funcfioning as a covariafe 
or confrol variable, differences in mafhemafics achievemenf were more 
likely affribufed fo course affendance fhan prior performance. For fhis 
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reason, prior mathematics achievement was present in all statistical 
analyses involving mathematics coursework so that the effects of 
mafhemafics courses on mafhemafics achievemenf could be adjusfed for 
prior mafhemafics ability. 

Mathematics coursework was a categorical variable made up of fhree 
cafegories: pure mafhemafics, applied mafhemafics, and low-level 
preparatory mafhemafics courses fhaf prepare sfudenfs fo enroll in a 
formal mafhemafics course (i.e., pure or applied mafhemafics). The 
provincial curriculum guides describe fhe rafionale and confenf of pure 
and applied mafhemafics. 

Pure mathematics emphasizes mathematical theory and the testing of 
mathematical hypotheses. The pure mathematics approach, which is often 
deductive and symbolic, endeavours to show that concepts are valid all the time, 
or valid within a well-defined set of restrictions. Real-life problems are then 
presented in order for students to apply previously learned mathematical 
concepts and procedures. (Alberta Learning, 2002b, p. 1) 

Applied mathematics gives students a clearer picture of why they are learning 
mathematics and motivates them in learning. Students experience mathematics 
as being dynamic and useful in their careers and everyday life. The approach 
used in applied mathematics is primarily data driven, using numerical and 
geometrical problem-solving techniques. As a way of increasing relevance, 
students collect data in experiments and activities and develop mathematics 
concepts from analyses of the data. (Alberta Learning, 2002a, p. 1) 

A table outlining the expected general outcomes for each of fhe fhree 
mafhemafics courses is available from fhe aufhors. We created fwo 
dichofomous variables fo represenf pure and applied mafhemafics 
courses, wifh low-level preparafory mafhemafics courses as fhe baseline 
effecf. Af fhe sfudenf level, confinuous variables (including mafhemafics 
achievemenf) were sfandardized fo have a mean of zero and a sfandard 
deviafion of one, and dichofomous variables were cenfred around fheir 
grand means. 

School-level characferisfics included variables measuring school 
confexf and climafe. School confexf included such variables as school 
size, school locafion, school mean SES, and material resources for 
mafhemafics. We have provided a descripfion of school climafe 
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measures (composite variables made from scales containing multiple 
items) in Appendix A. School-level variables were centred around their 
grand means. 

Some school-level variables, such as school SES and parental 
involvement, seem equally logical as student-level variables. Studies of 
school effects focus on how these variables define school context and 
climate (see Teddlie & Reynolds, 2000). For example, school SES 
measures school socioeconomic composition, and parental involvement 
is one of the most important measures of school climate (see Ma, 1999). 
In other words, these variables represent social and educational policy 
issues more than issues of individual differences. This treatment 
generates knowledge about how to help students in socially 
disadvantaged schools and how parental involvement can create a 
school-wide impact on academic achievement of all students. 

Data Analysis 

Because our data were hierarchically structured with students nested 
within schools, we used multilevel modelling techniques (Raudenbush & 
Bryk, 2002) to simultaneously determine which student (level one) and 
school (level two) characteristics significantly predicted mathematics 
achievement (see Kreft & De Leeuw, 1998). 

We tested four multilevel models. The first model, containing 
student-level variables with control for prior mathematics achievement, 
informed us of the effects of student background variables on 
mathematics achievement (after adjustment for prior mathematics 
achievement). 

achievement,^ = + P^prior,. + + p. 

Poj ~ Too Ao; 

The first equation is the student model that specifies that mathematics 
achievement of student i in school j is influenced by prior mathematics 
achievement and background variables (X^) of the student (an error term 
is also present to capture all possible errors due to uncontrolled student 
characteristics). The second equation is the school model where the 
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intercept (representing school average mathematics achievement) is 
allowed to vary among schools (an error term is also present to capture 
all possible errors due to uncontrolled school characteristics). No school- 
level variables were used at this stage to model this variation. 

We then added mathematics coursework indicators to statistically 
significant student-level variables and prior mathematics achievement in 
the second model that informed us of fhe effecfs of mafhemafics courses 
on mafhemafics achievemenf in fhe presence of sfudenf background 
variables wifh adjusfmenf for prior mafhemafics achievemenf (i.e., affer 
confrolling for sfudenf background variables and prior mafhemafics 
achievemenf). 

achievement,. = + P^pure,. + P^ppplied,. + P,prior,. + 

Poj ~ ^00 
Ay “ Tio ^ f^ij 
Plj ~ ^20 ^ 1^2) 

The firsf equafion specifies fhaf mafhemafics achievemenf of sfudenf i in 
school y is influenced by whefher fhe sfudenf enrolled in pure or applied 
mafhemafics as well as prior mafhemafics achievemenf and background 
variables of fhe sfudenf. The group of equafions fhaf follows fhe firsf 
equafion is fhe school model where fhe infercepf and coefficienfs 
associafed wifh coursework indicafors (represenfing coursework effecfs) 
are allowed fo vary among schools (error ferms are also presenf fo 
capfure all possible errors due fo unconfrolled school characferisfics). No 
school-level variables were used af fhis sfage fo model fhese variafions. 

In fhe nexf model, we added school-level variables fo examine 
whefher fhe presence of school effecfs (on mafhemafics achievemenf) 
could alfer fhe effecfs of mafhemafics coursework indicafors on 
mafhemafics achievemenf, 

achievement,. = P^. + P^pure,. + P^applied,. + P^prior^ + Y.px^. + f.. 
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Paj ~ ^00 ’^yqOj^cjj ^ f^oj 
Ay “ 5^10 ^ f^ij 
Plj ~ ^20 ^ l^lj 

where W represent school-level variables used to model variation in 
school average mathematics achievement. 

In the final multilevel model, we used school-level variables to 
model variation in coursework effects associated with pure and applied 
mathematics. 

achievement,. = + P^pure,. + /^^ppplied,. + /^^prior^ + + e^. 

A)y “ ^00 ^ f^oj 

Aiy “ 7l0 ’^TqOj^qj ^ 

Ay “ 5^20 ^ ^y^O^qj ^ l^ 2 j 

We took this systematic approach to test the impact of mafhemafics 
coursework on mafhemafics achievemenf. 

RESULTS 

Table 1 shows descripfive sfafisfics for fhe independenf variables, 
fogefher wifh coding information for all dichotomous variables. A mean 
for a dichofomous variable represenfs fhe proporfion of fhe group coded 
as one. These descripfive sfatisfics were in fheir original scales, excepf for 
mofher SES and fafher SES, which were sfandardized variables wifh a 
mean of zero and a sfandard deviation of one. Before multilevel analysis, 
we examined correlations among bofh sfudenf-level and school-level 
variables and found no high correlations af eifher level (fhe highesf 
correlafion was 0.24 af fhe sfudenf level and 0.67 af fhe school level). 
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Table 1 

Descriptive Statistics of Student and School Variables 

Variable 

Mean 

SD 

Student variables 



Grade 10 pure mathematics 



(taking = 1, not taking = 0) 

0.62 

0.49 

Grade 10 applied mathematics 



(taking = 1, not taking = 0) 

0.11 

0.32 

Gender (female = 1, male = 0) 

0.50 

0.50 

Age 

15.54 

0.62 

Number of parents 

1.83 

0.39 

Number of siblings 

2.24 

1.65 

Immigrant student 



(immigrant = 1, non-immigrant = 0) 

0.05 

0.22 

Aboriginal student 



(aboriginal = 1, non-aboriginal = 0) 

0.06 

0.24 

Minority student 



(minority = 1, non-minority = 0) 

0.08 

0.28 

Prior mathematics achievement 

73.75 

13.64 

School variables 



School size 

612.76 

362.77 

School location (urban = 1, rural = 0) 

0.62 

0.49 

Material resources for mathematics 

2.47 

0.55 

Academic expectation 

4.21 

0.44 

Disciplinary climate 

3.00 

0.38 

Parental involvement 

2.23 

0.62 

Principal instructional leadership 

3.97 

0.61 

Teacher commitment 

4.21 

0.58 

Teacher morale 

4.33 

0.49 

Teacher job satisfaction 

2.13 

0.48 

Teacher control 

4.17 

0.43 

Teacher influence 

2.72 

0.48 


Note: In addition, father and mother socioeconomic status (SES) are standardized 
variables (with a mean of zero and a standard deviation of one) at the student level, 
and school mean father and mother SES are standardized variables at the school 
level. 

Table 2 presents the proportion of variance in mathematics 
achievement explained by three multilevel models: (a) taking only 
student background variables into account, (b) taking statistically 






838 


XinMa &• Laureen ]. McIntyre 


significant student background variables (gender, age, immigrant 
student and Aboriginal student) and mathematics courses into account, 
and (c) taking statistically significant student background variables, 
mathematics courses, and school-mean mother SES (the only statistically 
significant school-level variable) into account. All three models 
controlled for prior mathematics achievement at the student level. To 
save space, this control will no longer be emphasized even though prior 
mathematics achievement was present in all statistical analyses 
involving mathematics courses. 


Table 2 

Comparison of Proportion of Variance in Mathematics Achievement Explained 
by Various Multilevel Models 



Student 

Student 

Student and 


variables 

variables 

school variables 


alone 

with coursework 

with coursework 

Between students 

0.28 

0.31 

0.31 

Between schools 

0.33 

0.38 

0.48 


Note: Student variables include gender, age, immigrant student, and aboriginal 
student with control for prior mathematics achievement. School variables 
include school mean mother SES. These variables are statistically 
significant at the alpha level of 0.01. 


The model with student background as student-level variables 
accounted for 28 per cent of the variance in mathematics achievement 
between students and 33 per cent between schools. In the next model, 
mathematics courses were added to statistically significant student 
background variables. Mathematics courses added 3 per cent of the 
explained variance in mathematics achievement between students and 5 
per cent between schools. Therefore, mathematics coursework 
demonstrated unique effects on mathematics achievement even after 
student background variables were controlled. 

The last model contained mathematics courses as well as statistically 
significant student-level and school-level variables. We added school- 
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level variables to model the intercept (school average mathematics 
achievement) to examine how school effects on mathematics 
achievement could change the effects of mafhemafics coursework on 
mafhemafics achievemenf. This model accounfed for 31 per cenf of fhe 
variance in mafhemafics achievemenf befween sfudenfs and 48 per cenf 
befween schools. We found no improvemenf in fhe explained variance af 
fhe sfudenf level. The improvemenf in fhe explained variance befween 
schools was obviously a resulf of fhe direcf modelling of school average 
mafhemafics achievemenf by school-level variables. Because no change 
occurred in fhe explained variance befween sfudenfs, we concluded fhaf 
fhe importance of mafhemafics coursework fo mafhemafics achievemenf 
as reporfed above remained unchanged even affer adjusfmenf for school 
effecfs on mafhemafics achievemenf. Overall, mafhemafics coursework 
shows imporfanf unique effecfs on mafhemafics achievemenf even in fhe 
presence of individual differences in and school effecfs on mafhemafics 
achievemenf. 

Table 3 corresponds fo fhe second and fourfh mulfilevel models, 
showing fhe fixed and random effecfs of mafhemafics coursework on 
mafhemafics achievemenf. A fixed effecf (on fhe dependenf variable) is 
expressed as a proportion of a sfandard deviafion associafed wifh one 
sfandard deviafion increase in an independenf variable. Even in fhe 
presence of sfudenf background variables, sfudenfs who attended pure 
mafhemafics achieved 0.45 SD (i.e., 45% of a sfandard deviafion) higher 
in mafhemafics achievemenf fhan sfudenfs who attended low-level 
preparatory mafhemafics courses. However, sfudenfs who attended 
applied mafhemafics did nof perform any beffer fhan sfudenfs who 
attended low-level preparafory mafhemafics courses. Such a paffern 
remained unchanged affer adjusfmenf for bofh sfudenf-level and school- 
level variables (wifh fhe effecf of pure mafhemafics being 0.48 SD and no 
effecf of applied mafhemafics). 

The random effecfs of mafhemafics coursework indicate fhe exfenf fo 
which fhe effecfs of mafhemafics courses varied across schools. The 
model adjusted for sfudenf-level variables showed fhaf fhe effecfs of 
pure mafhemafics varied significanfly across schools wifh one sfandard 
deviafion as 0.28 SD in effecf (fhe square roof of fhe variance 0.08). Some 
schools were doing beffer fhan ofhers in using pure mafhemafics fo 
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promote mathematics achievement. Although the average effect of 
applied mafhemafics was nof significant, the effects of applied 
mafhemafics did vary across schools wifh one sfandard deviafion as 0.33 
SD in effecf (fhe square roof of fhe variance 0.11). Some schools were 
more successful fhan ofhers in using applied mafhemafics fo promote 
mathematics achievement. Overall, mathematics coursework appears to 
be important to mathematics achievement (e.g., the same course was 
related to different levels of achievemenf across schools). This conclusion 
is consisfenf wifh fhaf obfained earlier fhrough fhe comparison of 
variance explained by various models. 

Table 3 

Effects of Mathematics Courses on Mathematics Achievement and Variation in 
Effects Across Schools, with Control for Prior Mathematics Achievement 


Adjusted for Adjusted for student 

student variables and school variables 


Average effects of coursework 

Effect 

SE 

Effect 

SE 

Grade 10 pure mathematics 

0A5*** 

(0.08) 

048 «* 

(0.07) 

Grade 10 applied mathematics 

0.07 

(0.11) 

0.07 

(0.12) 

Variation in effects across schools 

Variance 

Chi-square 

Variance 

Chi-square 

Grade 10 pure mathematics 

0.08 

39A4:** 

0.03 

28.21 

Grade 10 applied mathematics 

0.11 

37.87** 

0.12 

34.95=^=^ 


Note: **p < 0.01. ***p < 0.001. Both models (adjusted for student variables and 
adjusted for student and school variables) control for prior mathematics 
achievement. 


Once school-level variables were added (see the fourth multilevel 
model), schools were no longer variable in the effects of pure 
mafhemafics (variance became non-significanf). Schools were sfill 
variable in fhe effecfs of applied mafhemafics wifh one sfandard 
deviafion as 0.35 SD in effect. Therefore, we idenfified responsible 
school-level variables in fhe case of pure mafhemafics in fhaf school-level 
variables successfully accounfed for all fhe significanf variation across 
schools in fhe effecfs of pure mafhemafics on mafhemafics achievemenf. 
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Yet, school-level variables could not account for the significant variation 
across schools in the effects of applied mafhemafics on mafhemafics 
achievemenf. 

Addifional sfafisfical resulfs from fhe lasf mulfilevel model, 
presenfed in Table 4, illusfrafe fhose school-level variables responsible 
for significanf variafions across schools in fhe effecfs of mafhemafics 
coursework on mafhemafics achievemenf. Four sfafisfically significanf 
variables occurred af fhe sfudenf level (gender, age, immigranf sfudenf, 
and Aboriginal sfudenf). These variables were nof inferprefed because 
fhey were used as confrol variables (fogefher wifh prior mafhemafics 
achievemenf) fo show fhaf affer confrolling for fhese significanf sfudenf 
background variables, sfudenfs who affended pure mafhemafics courses 
sfill achieved 0.48 SD higher in mafhemafics fhan sfudenfs who affended 
low-level preparafory mafhemafics courses. In confrasf, affer adjusfmenf 
for sfudenf background variables, sfudenfs who affended applied 
mafhemafics courses did nof perform any beffer fhan sfudenfs who 
attended low-level preparafory mafhemafics courses. 

Two sfafisfically significanf school-level variables were responsible 
for fhe significanf variation across schools in fhe effecfs of pure 
mafhemafics on mafhemafics achievemenf. Firsf, fhe effecfs of pure 
mafhemafics were smaller in larger schools. Consider fwo schools wifh a 
difference of 100 sfudenfs in enrolmenf. Sfudenfs faking pure 
mafhemafics in fhe smaller school would achieve 0.05 SD higher in 
mafhemafics fhan sfudenfs faking pure mafhemafics in fhe larger school. 
Second, fhe effecfs of pure mafhemafics were larger in schools where 
feacher commifmenf was higher. Teacher commifmenf was measured on 
a scale from 1 fo 5 (see Appendix A). Consider fwo schools wifh a 
difference of one score poinf in feacher commifmenf. Sfudenfs faking 
pure mafhemafics in fhe school wifh beffer feacher commifmenf would 
achieve 0.22 SD higher in mafhemafics fhan sfudenfs faking pure 
mafhemafics in fhe school wifh poorer feacher commifmenf. Therefore, 
small schools and schools wifh high feacher commifmenf were more 
successful in using pure mafhemafics to promote mathematics 
achievement. The effects of feacher commifmenf were more fhan four 
fimes as sfrong as fhe effecfs of school size, indicafing fhaf feacher 
commifmenf was a much more imporfanf school-level variable fhan 
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Table 4 



Results of School Variables Explaining Variation 

in Effects of Mathematics 

Courses on Mathematics Achievement Across Schools, with Control for Prior 

Mathematics Achievement and Adjustment for Student Variables 

Effects of mathematics courses 

on mathematics achievement 



Grade 10 pure mathematics 

0.48*** 

(0.09) 

Grade 10 applied mathematics 

0.07 

(0.11) 

Effects of student variables 

on mathematics achievement 

Gender (female) 

.0.14*** 

(0.04) 

Age 

.0.14*** 

(0.04) 

Immigrant student 

-0.20’^ 

(0.08) 

Aboriginal student 

. 031 ^^* 

(0.09) 

Prior mathematics achievement 

Effects of school variables on the 
slope of Grade 10 pure mathematics 

037 *^* 

(0.05) 

School size 


(0.01) 

Teacher commitment 

Effects of school variables on the 
slope of Grade 10 applied mathematics 

022** 

(0.07) 

School size 

-O.OS’^’^ 

(0.02) 


Note: *p < 0.05. **p < 0.01. ***p < 0.001. School size is used as the number of units 
with 100 students as one unit. School size unit is increased from 1 to 100 to 
magnify the effect of school size. 


school size in terms of explaining the effects of pure mathematics on 
mathematics achievement. 

The effects of applied mathematics were also smaller in larger 
schools. Consider again two schools with a difference of 100 students in 
enrolment. Students taking applied mathematics in the smaller school 
would achieve 0.05 SD higher in mathematics than students taking 
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applied mathematics in the larger school. Therefore, small schools were 
more successful in using applied mafhemafics fo promofe mafhemafics 
achievemenf. The effecfs of school size were idenfical befween fhe pure 
and applied mafhemafics cases. Small schools were capable of using bofh 
pure and applied mafhemafics fo promofe similar improvemenf in 
mafhemafics achievemenf. 

DISCUSSION 

Summary of Principal Findings 

Mafhemafics coursework had crifical effecfs on mafhemafics 
achievemenf. The average effecf of pure mafhemafics was significanf 
even affer confrolling for prior mafhemafics achievemenf and 
fradifionally imporfanf predictors of mafhemafics achievemenf af fhe 
sfudenf level as well as school effecfs on mafhemafics achievemenf. The 
effecfs of pure mafhemafics varied significanfly across schools. School 
size and feacher commifmenf were responsible for fhis variation. 
Sfudenfs faking pure mafhemafics in smaller schools or in schools wifh 
better feacher commifmenf achieved higher in mafhemafics fhan 
sfudenfs faking pure mafhemafics in larger schools or schools wifh less 
feacher commifmenf. 

Specifically, a difference of 100 sfudenfs in enrolmenf was associafed 
wifh a difference in mafhemafics achievemenf of 5 per cenf of a sfandard 
deviation. A quarfer of a sfandard deviafion often indicafes a difference 
fhaf is subsfanfial enough fo warranf practical implications. To reach fhaf 
level, a reduction in school size befween 400 and 500 sfudenfs is 
required, which may nof be possible practically. In fhis sense, fhe effecf 
of school size can be labelled as small. In confrasf, a difference of one 
score poinf on a five-poinf scale of feacher commifmenf was associafed 
wifh a difference in mafhemafics achievemenf of 22 per cenf of a 
sfandard deviafion (neighbouring a quarfer of a sfandard deviafion), 
indicafing fhaf improving feacher commifmenf is a very achievable 
sfrafegy fo increase fhe effecfiveness of pure mafhemafics (and 
subsfanfial improvemenf in mafhemafics achievemenf can be 
anticipated). 

The average effecf of applied mafhemafics was nof significanf on 
mafhemafics achievemenf once we confrolled for prior mafhemafics 
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achievement and significant student background variables. The effects of 
applied mafhemafics did vary significanfly across schools. School size 
accounfed only for a porfion of fhis variafion leaving a significanf 
amounf of fhe variance unexplained. Sfudenfs faking applied 
mafhemafics in smaller schools achieved higher in mafhemafics fhan did 
sfudenfs faking applied mafhemafics in larger schools. A difference of 
100 sfudenfs in enrolmenf was associafed wifh a difference in 
mafhemafics achievemenf of 5 per cenf of a sfandard deviafion. Similar 
fo fhe case of pure mafhemafics, fhis effecf of school size can be 
considered small. 

Content and Amount of Mathematics Coursework 

Our resulfs supporf fhe argumenf fhaf mafhemafics achievemenf may be 
greafly influenced by fhe confenf rafher fhan fhe amounf of mafhemafics 
coursework (e.g., Hoffer, 1997). Alfhough we did nof direcfly compare 
fhe effecfs on mafhemafics achievemenf befween fhe confenf and amounf 
of mafhemafics coursework, we did provide empirical evidence on the 
critical role that the content of mafhemafics coursework plays in 
promofing mafhemafics achievemenf. Sfudenfs complefing pure 
mafhemafics demonsfrafed subsfanfially (almosf half of a sfandard 
deviafion) higher mafhemafics achievemenf fhan sfudenfs complefing 
preparatory mafhemafics courses, buf in confrasf, sfudenfs complefing 
applied mafhemafics did nof show any beffer mafhemafics achievemenf 
fhan sfudenfs complefing preparatory mafhemafics courses. The 
significanf effecfs of pure mafhemafics sfand ouf evidenfly given fhaf we 
confrolled for prior mafhemafics achievemenf when modelling fhe 
impacf of mafhemafics coursework. We conclude fhaf fhe confenf of 
mafhemafics courses maffers fo mafhemafics achievemenf. 

The pure mafhemafics course "emphasizes mafhemafical fheory and 
fhe testing of mafhemafical hypofheses" (Alberfa Learning, 2002b, p. 1). 
This course encourages sfudenfs fo approach mafhemafical concepfs and 
problems in a deductive and symbolic manner. The applied mafhemafics 
course, on fhe ofher hand, emphasizes a more practical approach fo 
mafhemafical concepfs and problems (Alberfa Learning, 2002a). This 
course emphasizes how mafhemafics can be useful in everyday life and 
in fufure careers. If appears fhaf an emphasis on fhe fheorefical aspecf of 
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mathematics (as in pure mathematics), rather than the practical aspect of 
mathematics (as in applied mathematics), relates more strongly with 
student mathematics achievement even after taking into account prior 
mathematics ability. Research evidence exists that supports this 
distinction (between theoretical and practical approaches). For example, 
the Third International Mathematics and Science Study (TIMSS) 1999 
video study showed that one of fhe mosf disfinguishable insfrucfional 
characferisfics of fhe high-achieving counfries (Ausfralia, Czech 
Republic, Hong Kong, Japan, Nefherlands, and Swifzerland) is fhaf mosf 
insfrucfions are presenfed in mafhemafical symbols rafher fhan 
everyday -life confexfs (see Hieberf ef al., 2003). 

More imporfanf fhan offering our empirical supporf, we have 
demonsfrafed fhaf fhe effecfs of pure mafhemafics on mafhemafics 
achievemenf were acfually quife sfable or robusf (even affer faking info 
accounf imporfanf sfudenf-level and school-level variables). Parficularly, 
fhe effecfs of pure mafhemafics on mafhemafics achievemenf are over 
and above fhe effecfs of sfudenf and school characferisfics. This 
conclusion has an implicafion for educafional policymakers. If fhe 
confenf of mafhemafics courses in high school is so imporfanf fo sfudenf 
mafhemafics achievement, then students should be required to increase 
the level of mafhemafics courses fhey fake for graduafion (see also 
Sebring, 1987). 

School Effects 

Based on our finding fhaf fhe effecfs of mafhemafics coursework (both 
pure and applied mathematics) varied significantly across schools, we 
suggest that some schools were more successful in using mafhemafics 
coursework fo promofe mafhemafics achievemenf fhan ofher schools 
(even fhough fhe average effecf of applied mafhemafics was nof 
significanf). This conclusion supporfs fhe imporfanf role of schools in 
shaping fhe relafionship befween mafhemafics coursework and 
mafhemafics achievemenf. Our analysis exfends fhe argumenf of 
Gamoran ef al. (1997) and Lee ef al. (1997) fhaf schools can use course 
offering fo influence sfudenf mafhemafics achievemenf. We have shown 
fhaf even when schools offer fhe same mafhemafics courses, fhey can sfill 
be differenfially effecfive in using fhese mafhemafics courses fo influence 
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mathematics achievement. 

An additional important finding of fhe currenf sfudy is fhaf we 
idenfified effecfive schools in using mafhemafics coursework fo 
influence mafhemafics achievemenf. Sfudents who fake fhe pure 
mafhemafics course are more likely fo achieve higher in mafhemafics 
achievemenf if fhey affend smaller schools, parficularly if fhey affend 
schools wifh higher feacher commifmenf. Sfudenfs who fake fhe applied 
mafhemafics course can also be expecfed fo achieve higher in 
mafhemafics if fhey affend smaller schools. Small schools wifh highly 
committed feachers are in an advanfageous posifion fo help sfudenfs 
succeed in learning pure mafhemafics. We suggesf fhaf promoting 
feacher commifmenf fo educafion is critical for sfudenfs enrolled in pure 
mafhemafics fo succeed. School size appears as fhe only significanf 
school-level variable across bofh pure and applied mafhemafics. 
Alfhough if is nof pracfical fo advocafe downsizing schools (a reduction 
befween 400 and 500 sfudenfs in our case), we believe fhaf some lessons 
abouf small schools benefif all schools. We wanf fo emphasize fwo 
imporfanf characferisfics regarding personal interactions in small schools 
which may be offered as a possible cause for fhe greafer effecfs 
associated with smaller schools. Often, smaller schools can afford more 
personal inferacfions fhaf can also spread over a longer period of fime 
fhan larger schools. The imporfance of homerooms may need fo be 
realized in large schools. Large schools may cenfre fheir feaching and 
learning acfivifies more around homerooms so fhaf sfudenfs can have 
increased and prolonged personal inferacfions wifh bofh teachers and 
peers. 

Although we included ten school-level variables that portray the 
climate or learning environment of a school, we defecfed only one 
variable sfafisfically significanf in predicfing fhe effecfs of mafhemafics 
coursework on mafhemafics achievemenf. In a mefa-analysis of school 
effectiveness, Bosker and Wifziers (1996) reporfed fhaf school effecfs 
fypically accounf for 10 per cenf of fhe variafion in sfudenf academic 
achievemenf. They highlighfed fhaf school effecfs are greafer for 
mafhemafics fhan for language and concluded fhaf school factors do 
matter fo mafhemafics achievemenf. Several specific sfudies related fo 
fhe effecfs of school climafe occur in fhe research liferafure. For example. 
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academic expectation (Zigarelli, 1996), disciplinary climate (Ma & 
Klinger, 2000), parental involvement (Thacker, 2000), and teacher 
commitment (Reyes & Fuller, 1995) have been identified as significant 
school-level predictors of mafhemafics achievemenf. 

Based on fhese sfudies, we expecfed fhaf some school climafe 
characferisfics would significanfly strengfhen fhe effecfs of mafhemafics 
coursework on mafhemafics achievemenf. The facf fhaf only teacher 
commitment showed such a function may be a result of schools being 
fairly similar in school climafe. The small sfandard deviafions among 
schools in school climate variables indeed indicate such a possibility 
(Table 1). Alternatively, we question whether school climate was 
measured adequately in the LSMP. Most scales measuring school climate 
have a small number of ifems, which may be offered as anofher possible 
explanation for fhe lack of significanf school climafe variables. 

Limitations and Recommendations 

The limifafion of fhe currenf sfudy resides wifh sampling and 
measuremenf. Sfudenfs and schools participating in fhe LSMP constifufe 
a volunfeering rafher fhan random sample, and we do nof have means fo 
compare fhis sample wifh fhe general population of sfudenfs and schools 
in fhe province of Alberfa. In addition, fhe return rate in some schools 
was low. Both facts speak to the limitation in terms of dafa collecfed in 
fhe LSMP. As mentioned earlier, there is the limitation in terms of 
measuremenf used in fhe LSMP. Furfher invesfigafions are encouraged 
fo pursue more represenfafive samples of sfudents and schools and 
develop more sensitive scales for measuring imporfanf consfrucfs such 
as school climafe. 

Anofher limifafion is relafed fo fhe design of fhe analysis. Sfudenfs 
were nof randomly assigned fo mafhemafics courses (i.e., pure, applied, 
and preparatory mafhemafics). We used prior mafhemafics achievemenf 
fo alleviate confounding effecfs coming from prior mafhemafics ability 
or curriculum streaming (into those mathematics courses). Although this 
strategy is statistically adequate, our measure of prior mafhemafics 
achievemenf may nof be as perfecf as one would expert. Furfher 
invesfigafions are encouraged fo develop better measures of prior abilify 
or sfreaming to produce "purer" effects of mafhemafics coursework. 
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The analytical design as discussed above also brings up the 
appropriateness of the term "effect." Some researchers prefer fo reserve 
fhis ferm for a frue experimenfal design involving manipulafion of 
variables. Af ifs very besf, fhe currenf analysis is a quasi-experimenfal 
design in which fhe ferm "effecf" does nof mean fhaf an effecf has been 
caused via manipulafion. This facf speaks fo fwo issues. Firsf, we used 
fhe ferm "effecf" in a loose manner for convenience wifhouf any causal 
implications (as if has been popularly used in fhe research liferafure). 
Second, we recommend fhaf a frue experimenfal design may need fo be 
pursued. The combinafion of small-scale frue experimenfal designs and 
large-scale quasi-experimenfal designs (like ours) may hold fhe key fo 
evenfually unwrap fhe complex relationship befween mafhemafics 
coursework and mafhemafics achievemenf. 

Finally, from a subsfanfive perspecfive, we recommend fhaf furfher 
invesfigafions examine whefher school curricular and insfrucfional 
characferisfics can sfrengfhen fhe effecfs of mafhemafics coursework on 
mafhemafics achievemenf. An alfernafive explanation for fhe lack of 
significanf school-level climafe variables is fhaf school curricular and 
insfrucfional characferisfics may be more responsible for fhe effecfs of 
mafhemafics coursework fhan school climafe. Affer all, mafhemafics 
teachers may put different curricular emphases on different topics, and 
the same enacted content may also be instructed differently. It is, 
therefore, imporfanf fo examine fhe effecfs of mafhemafics coursework 
under differenf curricular and insfrucfional conditions. 
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Appendix A: Description op Composite Variables at the School Level 
Material Resources for Mathematics 

Please indicate the extent to which each of the following school resources meets 
your instructional needs in mathematics: (a) Curricular resources (e.g., 
documents, guides, manuals); (b) Computers; (c) Computer software; (d) 
Calculators; (e) Manipulatives; (f) The library. (1 = does not meet, 2 = partially 
meets, 3 = adequately meets, 4 = completely meets) 

Academic Expectation 

(a) I have high expectations for the academic success of my students; (b) I 
encourage students to do extra work so they can get better grades; (c) I push 
students to achieve their full academic potential; (d) I believe all students in my 
class can master the curriculum; (e) I place greater emphasis on developing 
students' social and personal skills than their academic skills. (1 = strongly 
disagree, 2 = disagree somewhat, 3 = neutral, 4 = agree somewhat, 5 = strongly 
agree) 

Disciplinary Climate 

To what extent is each of the following matters a problem in your class: (a) 
Student tardiness; (b) Student absenteeism; (c) Cheating on tests; (d) Students 
disrupting the class; (e) Student apathy; (f) Conflicts among students. (1 = a 
serious problem, 2 = a moderate problem, 3 = a minor problem, 4 = not a 
problem) 

Parental Involvement 

Since the beginning of this school year, approximately how many students' 
parents or guardians have talked with you concerning their child's: (a) Academic 
performance; (b) Coursework in mathematics; (c) Behaviour in classroom or 
school; (d) Social relationships or interactions; (e) Absence from class? (1 = none, 
2 = 1-4, 3 = 5-9, 4 = 10-14, 5 = 15-19, 6 = 20+) 

Principal Instructional Leadership 

(a) My principal has communicated what kind of school he or she wants to the 
staff; (b) My principal's beliefs about what the main goals of our school should 
be are the same as mine; (c) My principal lets staff members know what is 
expected of them; (d) My principal does a poor job of getting resources for this 
school; (e) My principal enforces school rules for student conduct and backs me 
up when I need it; (f) My principal talks with me frequently about my 
instructional practices; (g) My principal provides support and encouragement. (1 
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= strongly agree, 2 = somewhat agree, 3 = neutral, 4 = somewhat disagree, 5 = 
strongly disagree) 

Teacher Commitment 

(a) I am committed to making our school one of the best in the province; (b) If I 
could start over, I would become a teacher again. (1 = strongly disagree, 2 = 
disagree somewhat, 3 = neutral, 4 = agree somewhat, 5 = strongly agree) 

Teacher Morale 

(a) I look forward to each day at school; (b) Teachers at this school have a 
positive attitude towards students; (c) Teachers at this school work hard to help 
their students succeed; (d) Our staff room has a friendly atmosphere; (e) Rules 
for student behaviour are consistently enforced by teachers in this school, even 
for students who are not in their classes; (f) There is a great deal of cooperative 
effort among the staff members. (1 = strongly disagree, 2 = disagree somewhat, 3 
= neutral, 4 = agree somewhat, 5 = strongly agree) 

Teacher Job Satisfaction 

(a) I find my professional role satisfying; (b) My success as a teacher is often 
hindered by having to do administrative tasks; (c) I have to follow rules in this 
school that conflict with my best professional judgment; (d) Most of my 
colleagues share my beliefs and values about what the central mission of the 
school should be; (e) In this school, staff members are recognized for a job well 
done. (1 = strongly disagree, 2 = disagree somewhat, 3 = neutral, 4 = agree 
somewhat, 5 = strongly agree) 

Teacher Control 

At this school, how much control do you feel teachers have in their classrooms 
over each of the following areas of planning and teaching: (a) Selecting textbooks 
and other instructional materials; (b) Selecting teaching techniques; (c) 
Evaluating and grading students; (d) Disciplining students; (e) Determining the 
amount of homework to be assigned; (f) Student promotion and retention. (1 = no 
control, 2 = little control, 3 = some control, 4 = considerable control, 5 = strong 
control) 

Teacher Influence At this school, how much influence do you think teachers have 
over school policy in each of the following areas: (a) Evaluating teachers; (b) 
Setting discipline policy; (c) Hiring new full-time teachers; (d) Deciding how the 
school budget will be spent; (e) Determining the content of in-service programs. 
(1 = no influence, 2 = little influence, 3 = some influence, 4 = considerable 
influence, 5 = strong influence). 




